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Abstract 

Admission control can be employed to avoid congestion in queueing 
networks subject to overload. In distributed networks the admission 
decisions are often based on imperfect measurements on the network 
state. This paper studies how the lack of complete state information 
affects the system performance by considering a simple network model 
for distributed admission control. The stability region of the network is 
characterized and it is shown how feedback signaling makes the system 
very sensitive to its parameters. 
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1 Introduction 

Consider an overloaded queueing network where the incoming traffic exceeds 
the service capacity over a long time period. In this case it is often necessary 
to employ admission control to avoid the network to become fully congested. 
Many networks of practical interest are composed of subnetworks, not all of 
which are administered by a single party. In such a network the admission 
controller seldom has complete up-to-date system information available. In- 
stead, the admission decisions must be based on partial measurements on 
the network state. 
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This paper studies the effect of imperfect information to the performance 
of the admission control scheme. Typical performance measures for well- 
dimensioned networks in this kind of setting include the average amount of 
rejected traffic per unit time, and the mean proportion of time the network 
load is undesirably high. However, assuming the network under study is 
subjected to long-term overload, there is another performance criterion that 
must first be analyzed, namely: If the network is subjected to a stationary 
load exceeding the service capacity, how strict admission control rules should 
one set in order to stabilize the system? 

To deal with the question mathematically, it is assumed that the net- 
work can be modeled using the simplest nontrivial model for a distributed 
network, the two-node tandem network with independent and exponen- 
tial service times and unlimited buffers. The network state is denoted by 
X = (Xi, X2) where Xi is the number of jobs in node i. It is assumed 
that the admission control can be modeled so that the input to the system 
is a Poisson process with a stochastic time-varying intensity, the intensity 
A = A(X) being a function of the network state. 

The lack of complete state information is reflected in the model by assum- 
ing that the input rate A is a function of only one of the Xi. If A (AT) = A(ATi), 
then the analysis of the system can be reduced to the study of birth-death 
processes, which are well understood. This is why in the following it is al- 
ways assumed that A(AT) = A(X2), so that the admission control introduces 
a feedback signaling loop to the system. For example, one can model a 
network where arriving traffic is rejected when the size of the second buffer 
exceeds a threshold level K by setting \{X) = 1(X 2 < K), see Figure 1. In 
order to also cover more complex admission policies with multiple thresholds 
and thinning of input traffic, the shape of A(AT2) will not be restricted in 
any way. 

l(X 2 < K) 
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Figure 1: Admission control based on the single threshold level K. 
More precisely, X is defined as a continuous-time stochastic process as 
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follows. Let A be a nonnegative function on Z + and /ii,/X2 > 0. Define the 
transition rates q(x, y) for x ^ y, x,y £ J? + by 



q{x,y) 



= < 



' \{x 2 ), y = x + ei, 

fit, y = x-e 1 + e 2 >0, 

[i 2 , y = x - e 2 > 0, 

0, otherwise, 



(1) 



where ej denotes the i-th unit vector of J? + . As usual, set q(x,x) = —q(x), 
where the transition rate out of state x is defined by 



It is clear that q(x) < oo for all x, so using the minimal construction [3, 5] 
the rates q(x,y) define a unique Markov process X on 1?, U {k}. Here k 
denotes an additional state not in with T K = inf{i > : X(t) = k} < oo 
being the time of explosion of X. The notation S(X, fj,x, 1x2) will be used for 
the set of transition rates corresponding to the the triple (A, Hi, 122), and the 
system S(X, Hi, H2) is said to be stable if the corresponding Markov process 
is ergodic, that is, irreducible and positive recurrent. 

In its most general form, the stability problem may now be stated as 

(PI) Characterize the set of all (A, H\,H2) 6 ^+ + x x R+ for which 
S(\, (it, H2) is stable. 

Specializing to networks with threshold-based admission control, the offered 
traffic is assumed to arrive at unit rate, without loss of generality. Denoting 
the admission threshold by K, (PI) now takes the form 

(P2) For each (fj,i, ^2) £ K+, determine for which values of K G Z + U {00}, 
if any, the system S{ 1(- < K), ^1,^2) is stable. 

Note that the system corresponding to K = 00 in (P2) is the ordinary 
tandem queue, for which it is well-known that min^x, fi 2 ) > 1 is sufficient 
and necessary for stability. On the other hand, assuming overload, answering 
the question on the existence of a threshold level that can stabilize the system 
is not as straightforward. 

The queueing systems literature includes a vast amount of work on var- 
ious admission control mechanisms. However, most earlier studies on tan- 
dem networks require at least one of the buffers to be finite, so that the two- 
dimensional nature of the problem can partly be reduced to one-dimensional 
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by applying matrix-geometric methods [9]. For networks with unlimited 
buffers and state-dependent service times, Bambos and Walrand [4] provide 
stability results extending to non-Mar kovian systems, however ruling out 
networks with the type of feedback signaling loop present here. Concerning 
the network S(\, [ii, (12) defined above, the compensation approach intro- 
duced by Adan, Wessels, and Zijm [1] can be used for computing the invari- 
ant measure in the special case where A is constant on {n £ Z + : n > 1}. For 
more general input rates, Leskela and Resing [7] have described a numerical 
method for calculating stationary performance characteristics of the system. 
Altman, Avrachenkov, and Nunez Queija [2] have recently introduced per- 
turbation techniques that seem appropriate for asymptotically analyzing the 
behavior of S(X, fj,±, ^2) under suitable parameter scaling. 

This paper partially answers (PI) by deriving sufficient and necessary 
conditions for stability. Furthermore, by showing that in the special case 
of threshold-based admission control the sufficient and necessary conditions 
coincide, a complete solution of (P2) is given. In addition, the sensitivity 
of the system is analyzed with respect to changes in the service rates and 
it is shown how acceleration of one of the servers may, rather paradoxically, 
destabilize the system. 

2 A sufficient condition for stability 

Let S be a countable set. For a function V : S — ► R, denote 

lim V(x) = 00 

if the set {x : V(x) < M} is finite for all MgI, Further, the mean drift of 
V with respect to transition rates q(x, y) is denoted by 

AV(x) = J2(V(y)-V(x))q(x,y), (2) 
assuming the sum on the right-hand side converges. 

Definition 1. A map V : S — > R is called a Lyapunov function for q if it 
satisfies the following conditions called Foster's criteria: 

(Fl) Yly^x \V(y) ~ V( x )\ l( x iy) < 00 f° r an x ( so that the right-hand side 
of (2) makes sense). 

(F2) lmx™ V(x) = 00. 
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(F3) There is a finite set So C S such that sup xgi s\s AV(x) < 0. 

The following continuous-time analogue of Foster's classical theorem [6] 
provides a sufficient condition for stability. 

Theorem 1 (Tweedie [10]). Let X be an irreducible Markov process on a 
countable state space S generated by transition rates q(x, y) so that q(x) < oo 
for all x. The existence of a Lyapunov function for q is then sufficient for 
X to be ergodic. 

Considering the system S(A, Hi, fiz), let q(x,y) be as defined in (1). 
Assume V is a function on of the form V(x) = x\ + v(x-i) for some 
v : Z + — > R with v(0) = 0. Searching for a Lyapunov function of this type, 
let us fix a number r > and require that the mean drift of V with respect 
to q satisfies 

AV(x) = —r for all x with x\ > 0. (3) 
It is straightforward to verify that (3) is equivalent to 

«(l) = l-(A(0) + r)//x 1 , 
v(n + 1) = 1 - (A(n) + r)/pL\ + (1 + H2/fJ,i)v(n) - H2/n\v(n - 1), n > 1. 

Denoting a(n) = 1 — (A(n) + r)//ii and w(n) = v(n + 1) — u(n), the above 
difference equation can be written as w{n) = a(n) + ^2/^1 w(n — 1) for 
n > 1, with w(0) = a(0). Thus, w(n) = Ylk=o a (^) (a*i/M2) n , so that 

n— 1 n— 1 3 

v(n) = Y,M3) = EE«W 

j=0 j=0 k=0 

and we conclude that (3) defines for each r > the function 

V r (x) = Xl + ^ ^(1 - (X(k) + r)//ii)) ( W //i 2 ) fc - J . 

j=0 k=0 

Thus we have constructed a family of functions V = {V r : r > 0} whose 
elements satisfy sup x::! , 1>0 AV r (x) < 0, so there are hopes that V r might 
satisfy (F3) for a suitably chosen finite subset of In order to investigate 
whether this is the case, let us study the mean drift of V r for x = (0, n) with 
n > 1, 

AV r (0, n) = A(n) - pL 2 {v r {n) - v r (n - 1)). (4) 
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Definition 2. For z > 0, denote Z n ~ geom n (z) if Z n is a random variable 
on Z n [0, n] with ~P(Z n = j) = cz 3 . For < z < 1, denote Z ~ geom(z) if 
the random variable Z on Z + satisfies P(Z = j) = (1 — z)z J . 

In this paper, Z n and Z will always represent generic random variables 
with distributions geom n (/ii//i2) and geom(/ii//i2), respectively. Using this 
notation, one may verify that (4) can be alternatively written as 

AT/ / n v EA(Z n )-/. 2 (l-r/ m )P(Z n >0) 

Ay r (0, n) = — — , Z n ~ geom n (/ii//i 2 ). 

P(Z n = n) 

(5) 

Theorem 2. TTie family V = {V r : r > 0} contains a Lyapunov function 
for S(X, jUi, // 2 ) croc? on/y i/ 

limEA(Z n ) < min(^i,/i 2 ), Z„ ~ geom n (//i//x 2 ). (6) 

in particular, if A(0) > 0, i/ien ffi'j is sufficient for the stability of S(X, fj,±, // 2 ). 

The proof of the theorem will utilize the following two lemmas. 

Lemma 1. Condition (6) is equivalent to lim AV^(0, n) < for some r > 0. 

Proof. Let Z n ~ geom n (//i/// 2 ) for n > 0. Observe first that since limP(Z n > 
0) = min(l,/ii//j, 2 ), 

UEEA(Z n )-min(/ii,/i 2 ) = lhn"{E A(Z„) - M2 P(Z n > 0)}. (7) 

Assume now that (6) holds. Then we can choose an r > so that E X(Z n ) — 
HiY{Z n > 0) < — r for n large enough. It follows that limAV^(0, n) < 0, 
since using (5) we see that eventually for large n, 

AK(0,n)< - r + r p ^ lP( f >0) =-r. 
P(Z n = ra) 

For the other direction, assume lim AVr(0, n) < for some r > 0. Then 
there is an s £ (0, r) so that for n large enough, AV r (0,n) < —s, and 
applying (5), 

EA(Z n )-/x 2 (l- S / m ) P(Z n >0) a w 
p^— ^ < AV r (0,n) < -s. 

This shows that 

EX(Z n ) -/i 2 P(Z n > 0) < -s(P(Z n = n) + /i 2 / Ml P(Z„ > 0)) = -s 

for all n large enough, and in light of (7) it follows that limEA(Z~ n ) < 
min(//i,/i2). □ 
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Lemma 2. Let f be a function of the form f(x) = u(x\) + v(x2) for some 
u,v : Z + — > M. Then lim x ^ QO f(x) = oo if and only if lim^^oo u(x\) = oo 
and lim^j^oo v(x2) = oo. 

Proof. Assume limu(xi) = \\m.v{x2) = oo, and fix an M G R. Since u$ = 
\niu{xi) and vo = iniv(x2) are finite, we can choose mi and m,2 such that 
u(x\) > M — vo for all x\ > mi, and v(x2) > M — uq for all X2 > m2- Hence, 
f(x) > M if either x\ > m\ or X2 > m2, so that the set {x : f(x) < M} C 
[0,mi] x [0, 1712] is finite. Since M was arbitrary, lim x ^oo/(x) = 00. 

Suppose next that lim^oo f{x) = 00. Then if limti(xi) < 00, there is a 
c 6 1 so that S = {x\ : u{x\) < c} is infinite. This implies that {x : f(x) < 
c+v(0)} D Sx {0} is infinite, contrary to the assumption lim^^oo f{x) = 00. 
Thus, limu(xi) = 00. Similarly, one proves that lim t> fx?) = 00. □ 

Proof of Theorem 2. Let r > and assume V r £ V is a Lyapunov function 
for g. Let So be a finite set so that (F3) holds. Then {0} x (no, 00) C Sq for 
some no, which implies 

Iim"Ay r (0,n) < sup AV r (0,n) < sup AV r (x) < 0. 

n>n xS5g 

By Lemma 1, this implies (6). 

For the other direction, assume that (6) holds. Applying Lemma 1, we 
can pick an r > so that lim A14-(0, ra) < 0. Hence, there is an no and an 
e > so that AV r (0, n) < — e for all n > uq. Denoting Sq = {0} x [0, no], it 
follows that 

sup AV r (x) = max{ sup AV r (Q, n), sup AV r (x)} < max{— e, — r} < 0, 

x£S£ n>n x:x!>0 

since by the construction of V r , AV r (x) = —r for all x with x\ > 0. Thus, 
V r satisfies (F3). Next, observe that using (4), 

A(n) — fJ-2(v r (n) — v r (n — 1)) = AV^.(0, n) < — e for n > no- 

This shows that v r (n) — v r (n — 1) > eventually for large n, so that 

linin^oo v r (n) = 00. By Lemma 2, we conclude that V r satisfies (F2). Fur- 
ther, (Fl) holds trivially since the set {x : q(x, y) > 0} is finite for all 
x. Thus, Vr is a Lyapunov function for q. Finally, note that X is irre- 
ducible when A(0) > 0. Hence, application of Theorem 1 now completes the 
proof. □ 
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3 Necessary conditions for stability 

Assume A(0) > so that the system S(\, Hi, ^2) is irreducible. In the 
previous section we saw that 

limEA(Z n ) < min(/ii,// 2 ), Z n ~ geom n (^i/^ 2 ), 

is sufficient for the stability of S(X, fj,±, /Z2). This section is devoted to study- 
ing whether the above condition is also necessary for stability. 

3.1 Small perturbations of Markov processes 

This section studies how ergodicity is preserved under small perturbations 
of generators of Markov processes. If q(x,y) and q'(x,y) are generators of 
Markov processes on a countable state space S, denote 

D(q,q') = {x : q(x,y) ^ q'(x,y) for some y} 

and 

D(q, q') = D(q, q') U {y : q(x, y) > or q'(x, y) > for some x E D(q, q')}. 

Further, for F C S let 

Tp = mf{t > : X(t-) / X(t), X{t) E F}, 

with the convention inf = cxd, and T x = for x E S. 

Lemma 3. Let X and X' be irreducible Markov processes on a count- 
able state space S generated by q(x,y) and q'(x,y), respectively, with q(x), 
q'(x) < 00 for all x. Assume that D(q,q') is finite. Then X is ergodic if 
and only if X' is ergodic. 

Proof. By symmetry, it is sufficient to show that the ergodicity of X' implies 
that of X. So, assume X' is ergodic, and let x be a state in D = D(q,q'). 
Denote the first jump time of X by r = inf{t > : X(t-) / X(t)}. By 
irreducibility, E x r < 00, so by the strong Markov property, 

E x T D = E x t + E x (E x{r) T d ;X{t) $ D). 
Since q(x,y) and q'(x,y) coincide outside D, and P x (X(t) E D) = 1, 

E*(E X(T) T D - X{t) £D) = E x .(E x(r) T' D - X(t) eD\D)< sup E, T' D . 

y&D 

Since X' is ergodic and D is finite, so is the right-hand side in the above 
inequality, and we conclude E x Tjj < 00. Because X is irreducible, this 
property implies that X is positive recurrent (Meyn [8], Theorem 4.3: (ii) 
and Theorem 4.4). □ 
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3.2 Bottleneck at node 1 

Assume \i\ < [i2- Intuition suggests that in this case the stability of the 
system depends on whether or not the buffer content at node 1 grows to 
infinity. Observe that during the periods of time where node 1 remains 
busy, the input to node 2 is a Poisson process with rate fj,±. The approach 
here is to compare the original process to a saturated system where node 2 
gets input at rate [i\ also during the time periods where node 1 is empty, and 
show that the stability regions for the two systems are close to each other. 
With this goal in mind, let us introduce another model family denoted by 
S N (X, [ii, fi2)- Fix a nonnegative integer N, and define for x ^ y, 

q (x, y) = q(x, y) + ^il(xi = 0, x 2 < N, y = x + e 2 ). 

It is clear that when A(0) > 0, the transition rates q N (x,y) define using the 
minimal construction an irreducible Markov process X N on U {k}. By 
Lemma 3 we know that the stability of S N (X, [12) is equivalent to that 
of S(X, [ii, /i2). Further, by letting N approach infinity, S N (X, [ii, [12) will 
resemble a network where node 2 receives stationary input at rate [ii. 

Lemma 4. Assume that S N (X, [ii, ll 2 ) is stable. Then the stationary distri- 
bution of X N satisfies 

EX(X?) = M2 P(Xf >0)-m P(Xf = 0,X» < N), (8) 
P(A^ = n) = ( m /^ 2 ) n P(A^ = 0) 

n-l 

- l(n >A0;C (Vi/H2) n - J P(Xi = 0, X? = j), (9) 

j=N 

and for all real-valued f on Z +; 

E(/(X 2 iV );X 2 iV < N) = Ef(Z N ) P(X? < N), Z N ~ geom^^i/^). 

(10) 

Proof. Starting from the balance equations for X N , it is not hard to check 
that EX(X 2 )=m P(Xf > 0), and 

[ii P(X? >0) + [i 1 P(Xf = 0, X$ <N) = [i 2 P(X 2 ^ > 0), 

showing that (8) is true. Further, it is straightforward to verify that for all 

n, 

P(A^ = n + 1) = [ii/ [12 [P(Xf = n) - l(n > N) P(Xf = 0, X? = n)] , 
from which (9) and (10) follow. □ 
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Theorem 3. Assume \i\ < and let Z ~ geom(/ii//^2). Then 

EA(Z) < /ii =^ S(\, fi±, [12) is stable, 
EA(Z) > /ii =>- S(A, /Ui, /i 2 ) is unstable. 

Proof. Let Zjy ~ geomjy(/xi/u 2 ). Because /Ui < ,u 2 , it follows that E A(-Zv) — > 
EA(Z) as iV — > 00. The first statement now follows from Theorem 2. 
To prove the second claim, assume that S(X, /j-i, ^2) is stable. Then by 
Lemma 3, so is S N (X, fii, 1x2) for each N. Applying (8) and (10) we see that 

E\(Z N )P(X? < N) = E(A(X 2 7V );X 2 7V < N) < t^H*? > 0). (11) 

Next, (9) implies 

P(X 2 iV > N) < (/V/^) n for all N, 

n>N 

so that limP(X^ < N) = 1. This observation combined with (9) implies 

p(x n m PP^<AQ 

P(A 2 - 0) - „ — - — > 1 - /ii/^ 2 , 

Ln=o(Ml/M2) n 

as A?" — > 00. Hence, limP(X 2 fvr > 0) = /Ui//i 2 . Letting A?" — > 00 on both sides 
of (11) now shows that EA(Z) < □ 

3.3 Bottleneck at node 2 

To study necessary stability conditions for the system when fi\ > /i 2 , the 
following asymptotical property of truncated geometric random variables 
will be useful. 

Lemma 5. Let Z n ~ geom n (z) with z > 1. Then for all nonnegative 
functions f on Z + , 

\jm f(n) <limE/(Z n ) <HEE/(Z n ) <lhrl/(n). 

Proof. Without loss of generality, assume lim/(n) < 00. Choose a number 
r so that lim/(n) < r. Then there is an no so that f{n) < r for all n > no, 
and thus 

E /(Z n ) < r + ^ ra . for n > n . 

This implies that limE/(Z n ) < r, so by letting r j lim/(n), it follows that 
limE/(Z n ) < lim/(ra). The proof is completed by applying this inequality 
to -/. □ 
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Theorem 4. Assume \i\ > fi2, and let Z n ~ geom n (^i/^2)- 27ien 

limEA(Z„) < /X2 =>■ S(X, fj,i, fj,2) is stable, 
lim A(n) > /X2 =>• S(A, Hit Hz) is unstable. 

Especially, if lim X(n) exists, then 

limA(ra) < ^2 =^ S(\, m, (12) is stable, 
limA(n) > fi2 =>• S(X, Hi, ^2) is unstable. 

Proof. The first statement follows from Theorem 2. To prove the sec- 
ond implication, assume S(X, fii, H2) is stable. Then by Lemma 3, so is 
S N (X, H\, H2) f° r each N. Choose an r 6 K so that r < lim X(n). It follows 
by Lemma 5 that lim X(n) < lim E X(Z n ). Thus, X(N) > r and EA(Ztv) > r 
for all ./V large enough. Thus, for all such N, 

EX(X?) = E(X(X?);X? > N) +EX(Z N )P(X» < N) 
> r P(X? > N)+r P(X^ < N) = r, 

so lim E X(X^) > r. Letting r approach lim X(n) we see that lim E A (Xf) > 
limA(ra). Next, limP(Xf > 0) = 1, because P(X^ = 0) < (EiLoW^P)" 1 
by (9). Moreover, equality (8) shows that EA(Xf ) < /x 2 P(X^ > 0) for all 
N, so that 

limA(n) <limEA(Xf) <lim/i 2 P(Xf > 0) = fi 2 , 

which proves the second claim. In the special case where A(n) has a limit 
when n tends to infinity, Lemma 5 shows that 

lim X(n) = limA(ra) = limEA(Z n ), 

so the last two implications of the theorem now follow from the first two. □ 

There may exist a substantial gap between the necessary and sufficient 
stability conditions of Theorem 4 if A(n) is diverging. To gain some insight 
why characterizing the stability of the system is difficult for such A, let 
us consider the behavior of S(X, fii, H2) as fii tends to infinity. Intuition 
suggests that in this case the system should resemble the single server queue 
with service rate fi2 and state-dependent input rate A(n), for which it is 
known (Asmussen [3], Corollary 2.5) that stability is equivalent to 

^ A(0)-A(n) 

2^ — m — <0 °- ( 12 ) 

n=0 ^2 
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Consider for example the input rates A(n) = a for n even, and A(n) = b 
for n odd, where < a < b. Then (12) reduces to y/ab < /i2, while with 
Z n ~ geom n (//i//i 2 ), 



limA(n) = a< ^ + ^ = Em'E A(Z W ). 
Mi + M2 



(13) 



Hence, the gap between the necessary and sufficient stability conditions in 
Theorem 4 grows according to 



fiib + fi 2 a 
Ml + M2 



[a, 6] , /xi 



oo. 



However, condition (12) may not in general be the correct asymptotical 
stability characterization of S(X, fii, H2) as /ii — ► oo, due to a fundamental 
difference between the single-server queue and the tandem network. Namely, 
if A(n) = for some n, then the single-server queue is stable because 
the queue size cannot exceed n. Obviously, this property is not true for 
5(A, Mi,M2)> arid this is why the necessary and sufficient stability condition 
for S(\, Hi, 112) must have more complex nature than (12). 



3.4 Eventually vanishing input rate function 

In most applications it is natural to assume that A(n) becomes eventually 
zero for large n, so that the admission controller strictly blocks all incoming 
traffic when the amount of jobs in node 2 becomes too large. In this case 
limA(n) = 0, so Theorem 4 shows that for /ii > /J2, 5*(A, fj,%, ^2) is stable 
regardless of the shape of the function A. On the other hand, if node 1 
is the bottleneck, then Theorem 3 determines the stability of the system, 
except in the critical case when EA(Z) = fj,±. Our intuition about birth- 
death processes suggests that the system is unstable also in this special case. 
The validity of this intuition will be proved next. The key to proof is the 
following lemma which shows that the stability of S(X, ^2) implies the 
stability of the saturated system S*(X, /ii, ^2), where node 2 behaves as if 
node 1 never were empty. 

Lemma 6. Assume [i\ < /i2, and A(n) = eventually for large n. If 
S(\, Hi, ^2) is stable, then so is the system S*(X, /ii, M2) generated by the 
transition rates 

q*(x, y) = q(x, y) + /Jil^i = 0, y = x + e 2 ), x^y. 
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Proof. Fix a K G Z + so that A(n) = for all n > K, and define the 
transition rates q' by 



q'{x, y) = q(x, y) + ii\l{xi = 0, x 2 > K, y = x + e 2 ), x ^ y. 

Because q'{x) < oo for all x, the rates q'{x, y) define an irreducible Markov 
process X' on Z+U{k}. The first step is to show that X' is ergodic. Note that 
set of states where q and q' differ is now given by D(q, q') = {0} x [K+ 1, oo). 
The key to the proof is to observe that the behavior of X' inside D = D(q, q') 
is similar to a birth-death process with birth rate fi± and death rate \i 2 . 
Denote x = (0, K+l). Then since [i\ < fi 2 , it follows that for all y G D\{x}, 

E y T x = ^f. (14) 
M2 — A*i 

The ergodicity of X implies E x _ e2 T' D = E x _ e2 < oo. Next, since 
P x - e2 (T' D < T' x ) = 1, we can compute using the strong Markov property 
and (14), 

E £-e 2 T'x = E z-e 2 ?D + E x'-e 2 (Ep(Ty ^x i X> { T 'd) ^ X ) 

- E x _ e2 i D + E x _ e2 — — — — - (15) 

-F T _i_ TT X 2(T D )-X 2 

— &x-e 2 J-D + &x-e 2 • 

A*2 - Ml 

Since T x = (y 2 — x 2 )/ fJ> 2 f° r all y G D \ {x}, we find in a similar way that 

Ex-e 2 T x = ~E x -e 2 Td + E x _ e2 — 2 ^ °^ -. (16) 

M2 

Since X is ergodic, comparison of (15) and (16) shows that E x _ e2 T' x < oo. 
Conditioning on the first transition of X' now yields 

pi rpl _ , Ml Tp rpl _|_ M2 -pp 

^i 1 ! ~ , "t" - Cj a:+e 2 "T J-<x-e 2 J i 

Mi + M2 Mi + M2 Mi + M2 

_ 1 , Mi _1 M2 F T / 



Mi + M2 Mi + M2 M2 - Mi Mi + M2 

showing that E x T' x < oo. By irreducibility, it now follows that X' is ergodic. 

Finally, note that the set D(q',q*) C [0, 1] x [0,K + 1] is finite. Thus, 
in light of Lemma 3 we may now conclude that the Markov process X* 
generated by q*(x,y) is ergodic. □ 
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Theorem 5. Assume that A(n) = eventually for large n. 

(i) If m < fj,2, S(A, Hi, H2) is stable if and only if EX(Z) < Hi with 
Z ~ geom(^i/^ 2 )- 

(ii) If Hi > H2, S(X, Hi, H2) is always stable. 

Proof. In light of Theorems 3 and 4, all we need to show is that the stability 
of S(X, hi, H2) implies EA(Z) < hi when hi < H2- So, assume hi < M2 
and that S(X, Hi, H2) is stable. By Lemma 6, so is S*(X, Hi, H2)- From the 
balance equations for X* it is easy to see that X| ~ geom( / ui / H2) ■ Thus 
the stationary mean rate of jobs arriving to node 1 equals EA(Z), while 
the corresponding rate out is equal to Hi^i^i > 0)- Because these two 
quantities must be equal in a stable system, we conclude that 

EX(Z) = hi~P(XZ >0) < hi, 

where the last inequality is strict because P(XJ = 0) > by the ergodicity 
ofX*. □ 

4 Sensitivity analysis of the stability region 

This section focuses on the stability of the system subjected to fluctuations 
in the system parameters. The treatment here is restricted to the case of 
eventually vanishing input rates, where Theorem 5 completely characterizes 
the stable parameter region. 

4.1 Sensitivity with respect to varying service rates 

The next proposition shows that with nonincreasing input rates, the stability 
of the system is preserved under speeding up of node 1. 

Proposition 1. Assume X is nonincreasing and X(n) = eventually for 
large n. Then for all Hi > Hi, 

S(X,Hi,H2) is stable =^ S(X,h'i,H2) is stable. 

Proof. Assume that S(X, Hi, H2) is stable and let Hi — Hi- If A*i — ^2, 
then S(X, h'i, H2) is stable by Theorem 5. On the other hand, if Hi < H2, 
then also Hi < H2, and the necessary condition of Theorem 5 shows that 
f {Hi 1^2) < Hi, where 

00 

f(x) = (l-x)^2X(n)x n . 

n=0 
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Because the sequence A(n) is bounded and nonnegative, / is differentiable 
in (0, 1) with 

oo 

f'(x) = ^(n + 1) (A(n + 1) - A(n)) x n < 0, 

n=0 

so that f{n'x/n2) < f(ni/n2)- It follows that /(/i'x/^) < Mi) which guaran- 
tees the stability of S(A, /i2) by Theorem 5. □ 

To see why it is necessary to require A to be nonincr easing, consider the 
following example. 

Example 1. Let [12 = 1, and assume that A(n) = for n > 3. Then 
5(A, jUi, /X2) is stable for all /Ui > 1, and for [i-y G (0,1), the stability of 
S(\, (ii, H2) is equivalent to 

/^(l - Mi) (A(0) + A(l) m + A(2) /x?) < 1. (17) 

Figure 2 shows the the left-hand side of (17) as a function of /ii, where 
A(0) = A(l) = and A(2) = 5. The plot illustrates that by increasing the 
service rate \i\ from 5 to | destabilizes the system. 




Figure 2: The left-hand side of (17) as a function of \x\. 



Alternatively, we may fix [i\ and see what happens when varies. The 
following proposition tells a rather surprising result: Even with nonincreas- 
ing A, acceleration of one of the servers may indeed destabilize the system. 
The physical intuition behind Proposition 2 is that when [12 is very large, 
the admission controller finds node 2 empty most of the time. This means 
that the input rate to the system is close to A(0). 
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Proposition 2. Assume A is nonincreasing and A(n) = eventually for 
large n and fix Hi > 0. Then 

• for A(0) < fii, S(X, Hi, H2) is stable for all H2 > 0, 

• for A(0) > fii, S(X, Hi, H2) becomes eventually unstable for large H2- 

Proof. Observe first that by Theorem 5, S(X, Hi, H2) is stable for all small 
H2 < Hi' To study the case with H2 > Ml> fix a number no so that A(n) = 
for all n > no- Then with Z ~ geom(Hi/H2), 

no 

E \{Z) = (1 - hi/ ^2) £ A(n)( Ml / M2 )" (18) 

n=0 

If A(0) < ui, then (18) implies that for all H2 > Hi, 

EX(Z) < A(0)(1 - (Hi/H2) m+1 ) < Hi, 

which by Theorem 5 is sufficient for stability. Moreover, the right-hand side 
of (18) converges to A(0) as H2 —> 00. From this we can conclude that if 
A(0) > hi, then EA(Z) > hi for large enough values of H2- By Theorem 5, 
<S'(A, Hi, H2) is unstable for such H2- D 

4.2 Phase partition for threshold-based admission control 

Consider the network with threshold-based admission control, and assume 
without loss of generality that jobs arrive to the network at unit rate. De- 
noting the threshold level by K, this system can be modeled as 5(A, Hi, H2) 
with A(n) = l(n < K). Theorem 5 now implies that for each K £ Z + U{oo}, 
the set of (hi,H2) for which the system is stable equals 

R K = {(hi, ^2) ■■ 1 - (hi/^2) K+1 < min(ui,/i 2 )}. 

Since Rk ^> Rk+i for all K, the stabilizable region is given by Uk<ooRk = 
Rq, while Roo = {(hi,H2) '■ mhr(ui, ^2) > 1} represents the system with 
no overload. The positive orthant of R 2 can now be partitioned into four 
phases as follows: 

• Ai = R oo is the region where the uncontrolled system is stable. 

• A2 = C\k<ooRk represents the region where any control stabilizes the 
overloaded system. 
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Figure 3: Phase diagram for threshold-based admission control. 



• As = Ro \ r\K<ooRK is the region where the overloaded system is 
stabilizable using strict enough admission control. 

• Ai = Rq is the region where the system cannot be stabilized. 

This partition is depicted in Figure 3. The phase diagram clearly illustrates 
the content of Propositions 1 and 2, showing that accelerating server 1 drives 
the system towards more stable regions, while speeding up server 2 may 
destabilize the network. 

5 Conclusion 

This paper considered the problem of characterizing the stability region of a 
two-node queueing network with feedback admission control. For eventually 
vanishing input rates, the characterization was shown to be complete. It 
was also illustrated how the presence of feedback signaling breaks down 
some typical monotonicity properties of queueing networks, by showing that 
increasing service rates may destabilize the network. 

For a diverging input rate function and bottleneck at node 2, the exact 
characterization of the stability region remains an open problem. Other 
possible directions for future research include generalizing the results for 
nonexponential service and inter-arrival times, and considering queueing 
networks with more than two nodes. 
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